Toshiba ASKMi at NTCIR-4 QAC2
نویسندگان
چکیده
Toshiba participated in NTCIR-4 QAC2 Subtask 1: this is our first QAC participation. Using our newly developed Japanese QA system called ASKMi, we submitted two runs, one using Okapi/BM25 for document retrieval (TSB-A) and the other using Boolean AND constraints before applying Okapi/BM25 (TSB-B). We achieved the 5th best performance among the 17 participants (8th and 9th among the 25 submitted runs). This paper briefly describes ASKMi, and analyses the formal run and oracle run results using Reciprocal Rank, as well as a new performance metric called Qmeasure which can handle multiple-answer questions and answer correctness levels.
منابع مشابه
ASKMi: A Japanese Question Answering System based on Semantic Role Analysis
This paper introduces a Japanese question answering system called ASKMi (Answer Seeker/Knowledge Miner). We describe its system components with an emphasis on the Question Analyzer, which performs Sematic Role Analysis for answer type recognition, query expansion and document constraint generation. Semantic Role Analysis is a rule-based, language-independent technique for mapping textual fragme...
متن کاملNTCIR-4 QAC Experiments at Matsushita
This paper investigates our experimental results for NTCIR-4 QAC2, the second attempt to evaluate the technology of Japanese question answering (QA). Our basic approach is a combination of information retrieval and named entity (NE) extraction based on pattern matching. The results show that the accuracy of NE extraction crucially affects the overall performance of our system. Additional experi...
متن کاملQuestion Answering Challenge for Information Access Dialogue - Overview of NTCIR4 QAC2 Subtask
We describe an overview of Question Answering Challenge (QAC) 2 Subtask 3, a novel challenge for evaluating open-domain question answering technologies, at the NTCIR Workshop 4. In QAC2 Subtask 3, question answering systems are supposed to be used interactively to answer a series of related questions, whereas in the conventional setting, systems answer isolated questions one by one. Such an int...
متن کاملAn Overview of NTCIR-5 QAC3
This paper provides an overview of NTCIR-5 QAC3 (Question Answering Challenge 3). QAC is a series of challenges for evaluating question answering technologies in Japanese. QAC3 follows the same course as QAC based on the success of the previous two workshops, with its task limited to that corresponding to QAC2 Subtask 3 aiming at the convergence of research resources for novel subjects. This ta...
متن کامل